Optimizing synchronizability of networks 
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In this paper, we investigate the factors that affect the synchronization of coupled oscillators on 
networks. By using the edge-intercrossing method, we keep the degree distribution unchanged to 
see other statistical properties' effects on network's synchronizability. By optimizing the eigenratio 
R of the coupling matrix with Memory Tabu Search (MTS), we observe that a network with lower 
degree of clustering, without modular structure and displaying disassortative connecting pattern 
may be easy to synchronize. Moreover, the optimal network contains fewer small-size loops. The 
optimization process on scale-free network strongly suggests that the heterogeneity plays the main 
role in determining the synchronizability. 

PACS numbers: 89.75.-k 05.45.-a 05.45.Xt 
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I. INTRODUCTION 

Many real networked systems exhibit some common 
characteristics, including small- world effect [l[ and scale- 
free property 0]. The network structure has significant 
impact on the dynamical processes taking place on it 
[3, 0, IS El- Recently, a particular issue is concerned 
the synchronization of individuals with coupling dynam- 
ics located at each node of a given network. It has been 
shown that the ability of a network to synchronize is gen- 
erally improved in both small-world networks and scale- 
free networks as compared to regular graphs @, H, Q- 
However, so far, a completely clear picture about the 
relationship between structure and synchronizability is 
lacking. 

How does the network topology affects its synchroniz- 
ability? Some previous works have shown that the av- 
erage network distance (d) is one of the key factors that 
affect the network synchronizability. The smaller (d) will 
lead to better synchronizability [ljj, [HI, Q3 , while other 
researchers found that the heterogeneity of degree can 
strongly influence a network's synchronizability, that is, 
a more homogeneous network will show better synchro- 
nizability compared to the heterogeneous one, though 
the average distance of a homogeneous network is longer 
[IH EH, El ■ In addition, some recent works demonstrate 
that the disassortative networks synchronize easier than 
assortative ones and the increasing clustering will 
hinder the global synchronization [l7l . [l8j . 

The majority of previous works are based on the sim- 
ulation results allowing tuning only one or a very few 
topological measures (see also some recently proposed 
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FIG. I: The sketch maps of edge-intercrossing operation. 



analytical approaches [19i . l20Ll2ll .l22l]). If all the topolog- 
ical properties can simultaneously vary, what will hap- 
pen? Should a network with better synchronizability 
have some particular properties? Besides the simulated 
and analytical approaches, a potential way to investi- 
gate the relation between structural and dynamical prop- 
erties is to track the optimization process, which will 
lead to some networks with specific dynamical charac- 
ters [23|, H3, HH- Concer ning with network synchroniz- 
ability, one pioneer work [261 ] . based on a modified sim- 
ulated annealing algorithm, suggested that the network 
having best synchronizability should be extremely ho- 
mogeneous. In Donetti-Hurtado-Munoz approach [26| . 
the rewiring operation is used, thus for different initial 
configurations, the optimization process will lead to the 
same optimal result, named Entangled Network. In this 
paper, as a complementary work, we would like to see 
the optimal results of keeping the degree of each node 
unchanged. With this idea, we take the network synchro- 
nizability as the object and change the network structure 
with the constraint condition that the degree of each node 
could not be changed, which can be realized by edge- 
intercrossing operation [2?], [H, [2{|. As shown in Fig. 1, 
the procedure of edge-intercrossing operation is as fol- 
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lows: (1) Randomly pick two existing edges e\ = x\Xi 
and e2 = £3X4, such that ii / 12 / 13 / £4 an d there 
is no edge between x\ and X4 as well as x 2 and x 3 . (2) 
Interchange these two edges, that is, connect x\ and X4 
as well as xi and £3, and remove the edges e± and e2 
simultaneously. 

This article is organized as follows: The concept of syn- 
chronizability and the optimization algorithm are briefly 
introduced in Sec. II and Sec. Ill, respectively. Then, in 
Sec. IV, we will give out the main simulation results for 
both homogenous and heterogenous networks. Finally, 
in Sec. V, we will summarize this work. 



II. SYNCHRONIZ ABILITY 
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Network synchronizability can be quantified by the 
eigenratio of the Laplacian matrix L. Consider a network 
of N identical systems with symmetric coupling between 
oscillators. The equations of motion for the system are: 

N 

x i = F(x i )-<T^L ij H(x J ), (1) 

3=1 

where Xj = F(xj) governs the dynamics of individual 
oscillator, H(x) is the output function and a is the cou- 
pling strength. The N x N Laplacian matrix L is given 
by 

!ki for i = j 
-1 for j e Aj , (2) 
otherwise 

where Aj denotes the set of i's neighbors. All the eigen- 
values of Laplacian matrix L are positive reals and the 
smallest eigenvalue Ai is zero for the rows of L having 
zero sum. The eigenvalues are = Ai < A2 . . . < An- 
The ratio of the maximum eigenvalue A at to the smallest 
nonzero eigenvalue A2 is widely used to measure the syn- 
chronizability of the network [3(J HH . If the eigenratio R 
satisfies R = < /?, where (3 is a constant depending 
on F(x) and H(x), then the network is synchronizable. 
The eigenratio R depends only on the topology of inter- 
actions among oscillators. The impact of having a partic- 
ular coupling topology on the network's synchronizability 
is represented by a single quantity R = 4& : The smaller 
the eigenratio R, the easier it is to synchronize the os- 
cillators, and vice versa. Having reduced the problem of 
optimizing the network synchronizability to finding the 
smallest eigenratio R of the matrix L, we shall seek the 
network with approximately best synchronizability by us- 
ing edge-intercrossing operation. 



III. ALGORITHM 

To obtain the approximately minimal R, we combine 
the intercrossing processes with a heuristic algorithm, 



FIG. 2: The eigenratio 7? vs. iteration steps of a WS network 
with rewiring probability p — 0.1. The network size is N — 
400 and the average degree is (k) = 6. Only the steps in 
which R being reduced are recorded. 



named Memory Tabu Search (MTS). The whole pro- 
cesses of the algorithm are (see also Refs. [HI, |H, [H| 
for the details about MTS): 

step 1: Generate an initial random graph Go with N 
nodes, E edges following a previously given degree distri- 
bution. Set G* = Go and compute the eigenratio R* of 
the Laplacian matrix of G* . G* and R* are used to record 
the current optimal configuration and the corresponding 
eigenratio, respectively. 

step 2: Stop and output the current result G* and 
R* if a prescribed terminal condition is satisfied. Other- 
wise, do intercross two randomly selected edges of G k {k 
denotes the time step, and is set as zero initially), and 
denote by G' and R 1 the resulting graph and its eigenra- 
tio. 

step 3: Update the current optimal eigenratio R* and 
set the current optimal graph as G* = G' if the eigenratio 
R' satisfies R' < R*. 

step 4: Update the new iteration resolution G k +i- If 
R' < Ra k or G' does not satisfy the tabu condition, set 
Gfc+i = G'; else set G k +i = G k . 

step 5: Update the tabu list. Let G k +\ enter into the 
tabu list. If k > L, where L is the length of tabu list, 
delete G k +i-L from the tabu list. 

step 6: Return to step 2 and set k = k + 1, where k 
always denotes the current time step. 

The following condition is used to determine if a move 
is tabu: > <^> which is the percentage improve- 

ment or destruction that will be accepted if the new move 
is accepted. Thus, the new graph G' at step 2 is assumed 
tabu if the total change in the objective function is higher 
than a percentage S. In this paper, S is a random number 
following uniform distribution between 0.50 and 0.75 and 
the selection of S will not affect the optimal result. The 
terminal condition is that the present step is getting to 
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FIG. 3: Some topological measures of the network vs. iter- 
ation steps, (a) The average distance (d); (b) The average 
clustering coefficient C; (c) Modularity M; (d) The Pear- 
son parameter of degree-degree coefficient r. As the same as 
shown in Fig. 2, the initial network is a WS network with 
N = 400, (k) = 6 and p= 0.1. 



the predefined maximal iteration steps. 

IV. SIMULATION RESULTS 

In this paper, four different kinds of extensively stud- 
ied networks are used for simulation. These are scale- 
free networks proposed by Barabasi and Albert (B A) [2| , 
small-world networks proposed by Watts and Strogatz 
(WS) [11, random networks proposed by Erdos and Renyi 
(ER) [35(1 , and the regular networks. The former one 
is heterogenous, while the latter three are homogenous. 
The simulation results of all the homogenous networks 
are almost the same, so, in this article, only the results 
of WS networks are shown. 

Fig. 2 reports the eigenratio R vs. the iteration steps 
of a WS network with rewiring probability p = 0.1. The 
tendencies of some other topological measures are shown 
in Fig. 3, these includes the average distance (d), the 
clustering coefficient C, the assortativity r (3(|, and the 
modularity M Based on Pimm's work [37[, 

M is defined as 

JV N 

I i=i j=i 

where Sij is the number of common neighbors of nodes i 
and j divided by their total number of neighbors. 

One trivial result is that the networks with better 
synchronizability are of shorter average distance. Be- 
sides, we observe that the degree correlation coefficient 
decreases from positive reals to negative ones, that is, 
the disassortative networks are, in general, easier to syn- 
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FIG. 4: (Color online) Number of ft-loops, Nh, in the network 
vs. iteration steps. The value of Nh in step zero corresponds 
to the case of initial network, which is a WS network with 
N = 400, (k) = 6 and p = 0.1. 



chronize. And, in the whole process, the average clus- 
tering coefficient reduces monotonically. The lower clus- 
tering and disassortative pattern of the optimal network 
are consistent with some previous results [H, [13, OH- 
More interestingly, the modularity decreases too, which 
indicates that a network with strong modular structures 
may be more difficult to synchronize, which is also in 
accordance with some recent results [4fj| . 

It has been found that many biological and technolog- 
ical networks contain motifs, that is, some specific sub- 
graphs appearing much more frequently than that ob- 
served in random graphs with the same degree sequence 
[4ll . |42| . Loop is one of the simplest but most significant 
subgraphs, for it accounts for the multiplicity of paths be- 
tween any two nodes [43| . Here we will show the change 
of loop structure in the optimization process. Due to the 
limitation of computational ability, we only calculate the 
number of loops from size 3 to 5. From Fig. 4, one can 
observe that the number of loops drops drastically during 
the optimization process, which indicates that the dense 
loops may hinder the global synchronization. As shown 
in Fig. 5, in WS networks, the number of loops will in- 
crease linearly as the increasing of network size, however, 
the number of loops in the optimal networks is stable and 
much smaller than that in the initial networks. 

All these results indeed state that the optimal net- 
works belong to a class of networks in which there are 
few number of loops, which may be different from the 
majority of real biological and technological networks. 
This phenomenon may deserve deep explorations in local 
structures of both artificial and real networks. 

As shown before, this algorithm is highly effective for 
homogenous networks. For example, the eigenratio of 
WS networks can be reduced to about 15% of the original 
value (see Fig. 2). Since the degree distributions of many 
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FIG. 5: (Color online) Number of /i-loops, TV h (TV), vs. TV in 
WS networks (WS, black squares) and the corresponding op- 
timal networks (OPT, red circles), respectively. The network FIG. 6: The eigenratio R vs. iteration steps of a BA network 
size grows from TV = 150 up to TV = 550. In all those Simula- with TV = 500 and (k) = 4. Only the steps in which R being 
tions, the rewiring probability and average degree are p = 0.1 reduced are recorded, 
and (k) — 6. The three panels from left to right are for h = 3, 
h = 4 and h = 5, respectively. 



real networks are heterogenous, next, we will check if 
this algorithm is also effective for heterogenous networks. 
As shown in Fig. 6, this algorithm can also enhance 
the synchronizability of scale-free networks, however, the 
enhancement is very small compared with the case of 
homogenous networks. In the optimization process of BA 
network, the tendencies of average distance, clustering 
coefficient, modularity and assortativity are almost the 
same as those for WS network (not shown), but with 
larger fluctuation and smaller decrement. Different from 
the case of homogenous networks, as the increasing of 
network size, the number of loops in both the optimal 
network and original BA network increases (see Fig. 7). 
The number of loops in the optimal network is a little bit 
smaller than that in the original BA network. 



V. CONCLUSION AND DISCUSSION 

In summary, a heuristic algorithm, memory tabu 
search, is used to optimize the network synchronizabil- 
ity by changing the connection pattern between different 
pairs of nodes while keeping the degree of each node un- 
changed. For both the homogenous and heterogenous 
networks, the change of some topological measures is 
recorded during the optimization process, which strongly 
suggests that a network with shorter average distance, 
lower clustering, negative degree-degree correlation and 
weaker modular structure may be easier to synchronize. 
In fact, these results has been reported respectively by 
some previous works. However, most of those works are 
based on some specific network models and can only re- 
veal the relation between synchronizability and one or 
two structural properties, while the present optimization 
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FIG. 7: (Color online) Number of /i-loops, N h (N), vs. TV in 
BA networks (BA, black squares) and the corresponding op- 
timal networks (OPT, red circles), respectively. The network 
size grows from TV = 200 up to TV = 500. In all those simu- 
lations, the average degree is (k) = 4. The three panels from 
left to right are for h = 3, h = 4 and h = 5, respectively. 



algorithm can simultaneously lay out the whole picture. 
Here, we would like to emphasize that, besides the tra- 
ditional simulated and analytical approaches, to track 
the optimization process is a powerful tool of analysis on 
the relation between structural and dynamic properties 
of networks. 

In addition, we investigated the change of loop struc- 
ture in the optimization process, and found that the num- 
ber of loops will decrease as the increasing of synchroniz- 
ability. That is to say, the networks with fewer loops 
will be easier to synchronize. More interestingly, in the 
original WS networks, the number of loops will increase 
linearly as the increasing of network size, while in the 
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optimal networks, this number keeps stable. This novel 
phenomenon deserves in-depth exploration. Since each 
node can only impact its neighbors (see Eq. (1)), if there 
is one path, of length I, between node i and j, then, 
along this path, it takes I steps transferring the synchro- 
nization signal from i to j (or from j to i). Therefore, if 
there are so many paths of different lengths between node 
i and j, the synchronization signal of i at a given time 
will arrive on j along different paths at different time, 
which may disturb each other. It may be the reason why 
dense loops will hinder the global synchronization. An 
extreme case is that for directed networks, the one with 
highest synchronizability (i.e. with eigenratio R being 
equal to 1) is a tree structure without any loops 
Even if adding one loop of length 2 45j, the eigenratio 
will be doubled [4(1 [47|]. However, the conclusion in Ref. 
pij may be not universal. Actually, in synchronization 
system consisted of non-identical oscillators, a counterex- 
ample against Ref. [3] is reported very recently [H[ . We 
believe this work will be helpful for the in-depth under- 
standing about the role of loops in network synchroniza- 
tion. 

Many previous works focus on synchronization on het- 
erogenous networks, especially scale-free networks. A 



common cognition is that the heterogeneity will hinder 
the global synchronization. However, since most of those 
works are based on some specific models, it is not clear 
whether the homogeneity is a necessary condition for 
strong synchronizability. Note that, for a fixed degree se- 
quence the present algorithm with edge-intercrossing op- 
eration is ergodic, thus the less efficiency of the present 
algorithm on scale-free networks indicate that the ho- 
mogeneity should be a necessary condition. That is to 
say, within the framework of synchronization of identi- 
cal oscillators with uniform coupling mode, the heteroge- 
nous network is hard to synchronize in despite of its id- 
iographic structure. 
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